Transferring system for huge and high quality images on network and method thereof

ABSTRACT

A transferring system for huge and high quality images on network and a method thereof are disclosed, wherein various individual image data are converted into high quality image data to be converted into layered image data, and classified into a plurality of sub cells, then stored in database as a compressed form. A client system connected to a server requires information, immediately downloads the required information, releases the compression, and then displays on a screen real time. In the present invention, a user can fast see only his wanted part since images of a newspaper and a magazine are converted as they were. Also, various additional information is provided with image, thereby providing multimedia digital publication services on wire or wireless network.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of U.S. patentapplication Ser. No. 17/091,430 filed Nov. 6, 2020, which is aContinuation Application of U.S. patent application Ser. No. 16/732,962filed Jan. 2, 2020, which is a Continuation Application of U.S. patentapplication Ser. No. 16/274,839 filed Feb. 13, 2019, which is aContinuation Application of prior U.S. patent application Ser. No.15/924,972 filed Mar. 19, 2018, which is a Continuation Application ofprior U.S. patent application Ser. No. 15/614,193 filed Jun. 5, 2017,which is a Continuation Application of prior U.S. patent applicationSer. No. 15/227,697 filed Aug. 3, 2016, which is a ContinuationApplication of prior U.S. patent application Ser. No. 14/579,293 filedDec. 22, 2014, which is a Continuation Application of U.S. patentapplication Ser. No. 13/362,046 filed Jan. 31, 2012 (now U.S. Pat. No.8,948,525), which is a Continuation Application of U.S. patentapplication Ser. No. 12/715,564 filed Mar. 2, 2010 (now U.S. Pat. No.8,131,093), which is a Continuation Application of 10/345,430 filed Jan.14, 2003 (now U.S. Pat. No. 7,702,160), which claims priority under 35U.S.C. §119 to Korean Application No. 10-2002-0028241 filed on May 21,2002, whose entire disclosures are hereby incorporated by reference.

BACKGROUND 1. Field

The present invention relates to a transferring system, andparticularly, to a transferring system of huge and high quality imageson network and a method thereof.

2. Background

Nowadays, it takes much time to display high quality image data in aclient computer through Internet service because of a limitation ofnetwork bandwidth or processing time in a main memory unit. Thatrequires expansion of the network bandwidth and increased capacity of amain memory unit, resulting in increasing cost of an overall system.

In the related art, newspaper and magazine service through Internet isperformed mainly with text or PDF format. The text service providesinformation with only letters, thereby having a limitation in addedimage information and various contents construction. Also, in PDF form,a file is downloaded according to a corresponding page on Internet anddata are read by using a special program.

In the related art, even if the method is used by some newspaper andmagazine service, a user has to download his wanted page each time andcan see the part after completing the download, thereby not providingoverall contents real time. Also, a constitution and a user interface ofthe downloaded page are not intuitive, and in case of PDF, screenrenewal time is influenced by a function of the user's computer system,resulting in that the method is not proper to real time service of highquality image data.

SUMMARY OF THE INVENTION

Therefore, an object of the present invention is to provide atransferring system which fast transmits image information withoutextending network bandwidth and increasing capacity of a main memorydevice and displays the image information real time and a methodthereof.

Especially, an object of the present invention is to provide a method inwhich a form of newspaper and magazine offered off-line is originallyconverted into high quality image data to provide real time on-line, andvarious multimedia contents and additional information are connected tobe utilized as a synthetic information offering media.

To achieve these and other advantages and in accordance with the purposeof the present invention, as embodied and broadly described herein,there is provided a transferring system for huge and high quality imageon network comprising an image converting system for converting digitalinformation into a high quality image format, the digital informationsuch as image information converted into a file possible to work in acomputer or image information read from a scan device; an image databasefor storing high quality image information made in the image convertingsystem; and a server system for transmitting image information stored inthe image database on network by a request of a client system.

Also, in the present invention, there is provided a method fortransferring high quality image on network comprising the steps ofconverting digital information into high quality image data by thefollowing steps of: (a) converting digital information into layered datawith different levels so as to output the digital information in theclient system with various magnification or contraction levels; (b)converting digital information into a plurality of sub cells to providea plurality of divided regions; and (c) compressing the divided digitalinformation as a sub cell unit; storing the converted high quality imagedata in database; and transferring high quality image data from a serversystem by a request of a client system on network.

The foregoing and other objects, features, aspects and advantages of thepresent invention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this specification, illustrate embodiments of the invention andtogether with the description serve to explain the principles of theinvention.

In the drawings:

FIG. 1 is a schematic view showing a structure of a transferring systemaccording to the present invention;

FIG. 2 is a schematic view showing communication between a server and aclient according to the present invention;

FIG. 3 a is a schematic view showing an image service in accordance withthe conventional art;

FIG. 3 b is a schematic view showing an image service in accordance withthe present invention;

FIG. 4 is a flow chart showing generation steps of high quality imagedata;

FIG. 5 is a schematic view showing layered data;

FIG. 6 is a schematic view showing a process for classifying a hugeimage and then transferring;

FIG. 7 is a schematic view showing one embodiment of a graphic userinterface;

FIG. 8 is a schematic view showing that a screen is renewed bytransmitting image information in the present invention;

FIG. 9 is a flow chart showing a real time service process of amultimedia digital publication in the present invention;

FIG. 10 is a screen capture showing an embodiment of GUI of a digitalnewspaper according to the present invention; and

FIG. 11 a screen capture showing an embodiment of GUI of a digitalmagazine according to the present invention.

DETAILED DESCRIPTION

Reference will now be made in detail to the preferred embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings.

A transferring system for huge and high quality images on networkcomprises a system for making original data be digital by a regular ruleand converting the data into high quality image format; a database forstoring the digital image data and managing; and a server system fortransferring the data real time on network.

Referring to FIG. 1 , a server system 10 possible to include atransferring system 12 extracts necessary information by connecting animage converting system 20 for generating high quality image data and adatabase 30 and then transmits the information on network. The database30 can additionally include an image database 32 having imageinformation and an additional information database 34 having additionalinformation.

In a method for transferring image data according to the presentinvention, as shown in FIG. 2 , a server/client model is applied andthen data are transmitted real time between the server system 10 and theclient system 40.

With respect to a client system, one or more systems simultaneouslycommunicate with the server system on network, and each client systemincludes a central processing unit and at least one memory unit and adisplay unit.

FIG. 3 a is a schematic view showing a related art image service. Imagedata stored in database 50 b of server 50 a are transmitted to theclient system through network 51 by a request of a client system, anddisplayed on a screen window 55 through a video buffer 54 via mainmemory 53 a, 53 b, . . . 53′. At this time, since capacity of image datais much greater than another information, the main memory unit of theclient system has to be large, and long transmittance time causes delayuntil the data are displayed on a screen window. Also, as capacity ofimage data is restricted by physical capacity of the main memory 53 a,53 b, . . . 53′, there is a limit to provide huge and high quality imagedata real time.

Meanwhile, in the transferring method, as shown in FIG. 3 b , highquality image data stored in the database 50 b of the server 50 a arecompressed as a divided form and stored. The image data are transmittedto the client system 52 through the network 51 only for parts requestedby a client, then compression of the image data is released in theclient system real time, and displayed on the screen window 55 via themain memory unit 53 and the video buffer 54. Accordingly, in the systemand method of the present invention, even if capacity of a memory in aclient system is less or network bandwidth is less, informationrequested by a client is displayed real time.

In the present invention, network includes all means in which not onlywire Internet or wireless Internet but also all kinds of intranets andat least two electronic media are connected for communication.Hereinafter, network will be explained mainly about Internet.

High Quality Image Data

High quality image data according to the present invention is a specialformat which fast displays huge image through network in a clientsystem. By using the format, huge image can be fast displayed withoutdelay of time, and fast searched. Also, approximate information issearched by contracting the huge image with layered data, and minuteinformation is searched by magnifying the image. The magnification andcontraction processes also work fast.

Digital information including huge image information is converted byimage converting system of the present invention by the following mainthree steps.

-   -   converting huge image into multiple layered data according to        levels    -   dividing the huge image into a plurality of sub cells    -   compressing the image as divided cell units

To convert into high quality image data, general image files such asBMP, GIF, PNG, JPG, etc. are used as original text contents. Also, atext file such as PDF is converted into an image file for use.

Original image files are converted into high quality image data by stepsshown in FIG. 4 . First of all, a plurality of layers sequentiallystructured from an image file are generated (60). Then, the layered dataare divided into a plurality of sub cells (62), and compressed asdivided cell units (64). Then, each index is endowed to the compressedcells (66), and each cell is integrated to be stored in database (68).The processes will be explained in detail.

Generation of Layered Data

In the present invention, image data having a layered structure aregenerated so as to provide high quality image in which images ofmultimedia digital publication and etc. transmitted real time on networkare magnified or contracted fast and accurately according to levels.That is, a plurality of data layers converted with ½n, . . . , ¼, ½, 1times, etc. of an original image are generated.

FIG. 5 is a schematic view showing layered data. As shown in FIG. 5 ,high quality individual images are constituted by layers according todisplayed levels at the time of magnification or contraction, andrespective layers 70, 80, and 90 are used in magnification orcontraction steps. That is, in case of magnifying, images are displayedfrom upper data 70 to bottom data 90 via middle data 80. On thecontrary, in case of contracting, images are displayed in reverse order.Also, it is possible to change the displayed screen discontinuously.

The number of layers in the layered structure are determined by graphicuser interface (GUI). In FIG. 5 , data layers of three steps areillustrated, but if graphic user interface can provide a function ofmagnification or contraction with four steps, image data are convertedto have four layers.

Division of Huge Image

The generated data layers are divided into a plurality of sub cells. Bydividing the data, huge image is fast transmitted. Division units of thehuge image into a plurality of sub cells are determined by a processingability of a client system and a transmittance speed on network. At thistime, a number of sub cells are determined within an optimum scope.Indexes are endowed to each cell of the divided images, and the imagesare integrated by positions or orders. The integrated cells exist as onefile, but only corresponding cells of the huge image are transmitted bya client's request. According to this, a client can fast see his wantedimage.

Referring to FIG. 6 , a process for displaying the divided image datareal time on network will be explained. Individual image data 110 and120 stored in database consist of sub cells respectively. In Figure, Eijand Fij represent sub cells of i line and j column.

As aforementioned, dividing image data into each sub cell unit and thenstoring is determined by a processing ability of a client system and atransmittance speed on network. At this time, if a large number of subcells are divided, a processing speed in a central processing unit of aclient system is down, and if few sub cells are divided, a transmittancespeed on network is down. Therefore, it is important to divide the subcells within an optimum scope.

For example, supposing that screen display resolution is 1024×768 pixel,images displayed on a screen are divided into 5 horizontal sub cells and4 vertical sub cells. The cells divided at an optimum condition preventdelay in a transmitting process or in a display process, and transmitimage fast.

The divided sub cells are compressed, and endowed with indexes, so thatpositions and coordinates etc. in an overall image are recorded. Then,the sub cells are integrated into one file and stored in database.

Compression of the Divided Image Data

High quality image data according to the present invention are stored asa compressed form so as to improve a transmittance speed.

It is preferable to compress data into each divided sub cell unit. Atthis time, compression technique such as widely known JPEG, GIFE areused. Each sub cell can be compressed with a same method independently,or compressed with different methods. For example, in case of datahaving a figure and a picture together, GIF compression is used at thefigure and JPEG compression is used at the picture. By doing so, it ispossible to improve compression efficiency of an image.

The compressed sub cells are integrated according to orders andpositions, and are endowed with indexes respectively, then stored indatabase. The indexes can include not only base information of sub cellsbut also additional information relevant to the sub cells. A serversystem is accessed to the indexes and selects sub cells of a wantedimage, thereby fast transmitting.

Transmittance of the Divided Image

If the client system requests special image information (for example,click of a special item in a graphic user interface circumstance, ormove of a view point), a server system selects only sub cells relevantto the client's request information in image data stored in database andtransmits the sub cells to the client system.

For example, in case that a client requests special information (110 a)among one individual image data 110, only relevant sub cells (E11, E21,E12, E22) are transmitted on network (130) since sub cells of theindividual image data are E11, E21, E12, and E22. Also, the clientsystem releases compression of the transmitted sub cells in a centralprocessing unit (compression will be later explained), and displays onlya displayed part 110 a in a display unit through a main memory unit.

Meanwhile, in case that the client system requires information includedin at least one individual image, sub cells are transmitted by thefollowing method. In FIG. 6 , if the client requests another specialpart 120 a, the server system transmits sub cells relevant to the part120 a among the two individual image data 110 and 120 to the clientsystem, the sub cells, E33 and E34 included in the first image data 110and F13 and F14 included in the second image data 120. The client systemreleases compressions of the transmitted sub cells in a centralprocessing unit, and displays only displayed part 120 a in a displayunit through a main memory unit (140).

Once individual image data are divided into sub cells and only requestedcells by a client among the divided sub cells are transmitted, hugeimage can be fast transmitted and displayed, even if capacity of a mainmemory unit in the client system is less, a processing ability of a mainprocessing unit is less, or data transmitting speed on network is low(that is, bandwidth of transmittance line path on network is less).

Client/Server Model

High quality image data generated from the image converting system canbe displayed with just less memory and less calculation of a mainprocessing unit when a client system receives an image file. The reasonis why only required parts among sub cells divided from huge image dataare selected, transmitted, and displayed. The larger original text imagesize (information amount) is and the more the number of layers is, themore advantage is obtained.

The present inventors applied the advantage to the client/server modelin which network such as Internet line is used and developed a powerfulimage providing solution. Accordingly, in the present invention, at bestutilized is display ability of a client system having limitation intransmitting data on network (that is, bandwidth), storing for thetransmitted data, and processing the data, thereby providing huge imagereal time.

A server system is connected to image database for storing high qualityimage data and additional information database for storing additionalinformation, thereby providing information requested by a client systemreal time. Like the transferring system 12 in FIG. 1 , the server systemcan include an independent system for selecting required informationfrom database and transmitting to the client system at an inner side andcan include database together. On the other hand, image database andadditional information database can be constituted as additionaldatabase or exist in another system.

A client system includes a central processing unit, a memory unit, adisplay unit, and a browser for connecting to each server throughnetwork. Once the client system is connected to the server fortransferring high quality image data according to the present inventionon network, the client system automatically receives a client programfor processing the high quality image data.

The client program provides various graphic user interfaces, fastreceives various contents provided from the server, and displays in theclient system. FIG. 7 is a schematic view showing one embodiment of agraphic user interface. In FIG. 7 , a graphic user interface consists ofa function button region 201, a section menu and search region 202, andan image display region 203. The user interface can have variousconstructions and forms according to kinds of transmitted image data anduser's convenience.

High quality image data according to the present invention are appliedto the client/server model, so that huge image information istransmitted on network fast and efficiently and displayed in the clientsystem.

In the present invention, contrary to the related PDF service and JPEGimage providing solution where an overall image file is transmitted,only a request part by a client system is transmitted and displayed realtime, thereby having a more excellent performance. Also, since imagesare fast magnified or contracted according to levels by a layered datastructure, an efficient search of image information is possible. Thatis, it is possible to transmit, display and search image informationreal time by image streaming.

In each index of high quality image data, not only information regardingto sub cells but also additional information are recorded. Theadditional information includes moving image, text, sound, web pageinformation regarding to each sub cell. Therefore, if the server systemtransmits the additional information to the client system with the imagedata, a user of the client system can receive information of the movingpicture, text, web page, etc, together with image.

Information Request by a Client

It is general for an Internet user to search image by moving a viewpoint shown on a screen of a display unit such as a monitor of a clientsystem. Image information requested by a client system exists in aserver system, so that the client system has to request transmittance ofcorresponding information to the server.

The process works by a series of streaming packet defined in advance,and is performed by a client program already transmitted to thetransmittance system in the server system and the client system. Theprocess will be explained in detail.

A user is connected to a server on network in a client system. To thefirst connected user, a client program is automatically transmitted froma server at the time of connection (to the user already connected, theclient program needs not to be transmitted), and the client programmakes the user search information requested by the server by providinggraphic user interface in the client system.

The user requests image information and image level change in theinterface provided by the client program. The process is shown as aclick for items and icon on the interface displayed on a screen.

By the process, a request by the client system is transmitted to theserver on network. The server receives the request and searches subcells corresponding to a part requested by the client system, thentransmits one by one real time.

In the client system, compressions of sub cells (image tile) transmittedfrom the server are released real time in a central processing unit, andthe sub cells are displayed on a screen via a main memory unit and avideo buffer. Accordingly, a screen is immediately displayed withoutdelay of image processing in the client system.

If the user moves a view point to a new region on interface of a monitorscreen or changes an image level, the client program transmitsinformation request for the new image region or image of different levelto the server.

FIG. 8 is a schematic view showing that a screen is renewed bytransmitting image information according to the present invention. Ifdisplay data 110 a and 120 a transmitted from database of the server aredisplayed on a screen 250 and the screen is moved (260), image data fora new region 260 a are transmitted from the database of the server andintegrated with the original display data 110 a or 120 a in the clientsystem. The integrated data constitute a new integrated image (260 a and110 a or 260 a and 120 a) and are displayed on a screen window.Accordingly, screen change is not delayed or discontinuous, rather acontinuous display like moving image is possible.

Providing Additional Information

In a state that the server selects image data from database according toa request of the client system, if additional information is included onindex, the additional information is transmitted to the client systemwith image data.

The additional information is stored in additional information databaseof the server. In the database, a location (that is, image data whichwill be displayed with the additional information), kinds, and styles ofthe additional information (for example, in case of text information,color, font, and in case of moving image information, image path) arestored. The additional information can be generated through a separatetool and can be input by a hand work.

It is preferable to manage the additional information provided with highquality image according to the present invention through a separatefile. The file is defined as MAP file in the present invention. Theadditional information management file consists of a script language,and contains a position and an attribute of the additional informationon the basis of resolution of high quality image.

For example, in case of providing moving image of Abc.mpg in 500×500position of 1000×1000 high quality image, if an image file name isAbc.IPQ, Abc.MAP having the same file name are generated and defined asfollows.

Movie 500, 500 Abc.mpg

The additional information file (Abc.mpg) and the management file(Abc.MAP) are stored in additional information database. If imageinformation requested by the client is Abc.IPQ, the server connects theimage information with Abc, MAP and transmits to the client system withAbc.mpg.

Preferred Embodiments

Hereinafter, real time service of multimedia digital publication will beexplained in detail.

FIG. 9 is a flow chart showing a real time service process of amultimedia digital publication according to the present invention.

In a data collecting step (310), individual image data and additionalinformation data which will be constituted as real time integrated dataare collected. The individual image data are generally interactive oneanother. Examples of the individual data include data which scanned eachside of a newspaper, data which scanned each side of a magazine, imagedata converted in PDF file, and image data directly converted fromtypesetting system, etc. Also, the additional information data whichwill be used in the step includes moving image file, sound file, anotherimage file, text information, and web page address, etc.

A manufacturing step (320) is a step for converting data collected inthe data collecting step into individual high quality image data and forconnecting with additional information data.

A file converted from PDF and from typesetting system is converted tohigh quality image file according to the present invention, and anewspaper and a magazine are scanned to be manufactured as an imagefile, thereby generating high quality image. In the step, methods suchas the aforementioned data layer generation, image division, andcompression, etc. are used.

Also, in the step, a search keyword necessary to an image search isextracted. The keyword can be a theme word regarding a headline in caseof a newspaper. Then, determined is whether individual image, searchkeyword, and additional information collected in the data collectingstep 310 are interactive one another or not. In the case, the additionalinformation can be edit by hand work or another tool (editing tool), ordata relevant one another are connected to be integrated.

Then, respective data are stored in high quality image database andadditional information database (330).

In a transmitting step (340), at the time of transmitting informationaccording to a request of a client on Internet network, only datadisplay region 110 a or 120 a are transmitted.

In a displaying step (350), the transmitted data display region isdisplayed on a screen window via a central processing unit, a mainmemory unit, a video buffer, etc. in the client system.

As shown in FIG. 9 , the server reads data stored in database when theclient requests individual image and additional information andtransmits the data to the client through Internet. At this time, in casethat image data requested by a client are on several individual images,corresponding data (that is, each sub cell) are transmitted real time,and integrated in the client system to constitute as one image. Theadditional information selects corresponding information in additionalinformation database and transmits with image data real time as astreaming form.

FIG. 10 is a screen capture showing an embodiment of GUI of a digitalnewspaper according to the present invention.

A function button region (corresponding to 201 of FIG. 7 ) includes atool for selecting a newspaper according to kinds, a tool for selectinga page of the selected newspaper, a tool for selecting a part ofdisplayed digital newspaper, a tool for displaying the selected region,and a clipping function for storing the selected region or individualimage as another file.

In section menu and searching region (202 in FIG. 7 ), contents of anewspaper are classified into an entire headline, politics, economy,society, culture, international, sports, entertainment, region, andserials, etc., and corresponding individual image information isincluded. The searching region consists of a part for inputting a searchkeyword and a part for displaying a search result. The search result isdisplayed at a bottom of the section menu as a list form.

In image display region (203 of FIG. 7 ), selected individual image andreal time integrated image are displayed.

High quality newspaper or magazine image transmitted from the databaseof the server can be displayed with various methods besides the methodsshown in the preferred embodiments.

Meanwhile, if a user moves a view point along displayed images by usinga mouse, only renewed region is transmitted from the server anddisplayed. Even if the user moves high quality digital image to anydirections, image data of the new region are transmitted real timewithout delay in a transmitting process and displayed on a screen. Also,if the user clicks a wanted part with a mouse, the part canautomatically move to a center of a screen.

Image magnification or contraction function is performed by locating amouse cursor to a wanted part and clicking. The magnification orcontraction can be performed by a layer unit step by step, or can beperformed at one time from the highest step (70 of FIG. 5 ) to thelowest step (90 of FIG. 5 ). At this time, the renewed data aredisplayed by the same method shown in FIG. 8 . In case of magnifying orcontracting image, various effects can be simultaneously realized byusing contents such as sound, image, text, and flash animation, etc.

In case that hyper-linked additional information exists at a specialposition of image displayed from a display unit of the client system,the corresponding information is displayed on a screen real time. Atthis time, the additional information can be displayed on a currentwindow, or on a new window. Additional information data that will beused with high quality image includes moving image file, sound file,flash animation, another high quality image file, text information, andweb page address, etc. FIG. 11 shows a real time service of a magazinecorresponding to one of multimedia publications. Alike theaforementioned embodiments, various additional information can beprovided with high quality image data. Also, in case that another imageis requested besides the information shown on a screen, a screen isrenewed real time and displayed in the client system.

According to the present invention, high quality image data are providedreal time without extending network bandwidth and increasing capacity ofa main memory device. Especially, huge image information is provided ashigh quality image data without extending a client system and delayingtime.

Also, in the present invention, possible is real time service of highpicture quality multimedia digital publication, and image data andrelevant additional information data are provided through a graphic userinterface, so that a user can easily obtain various information. Also,wanted information is fast searched, and same resolution is maintainedat the time of magnifying a screen. A real time service of high picturequality multimedia digital publication can be applied to allpublications issued periodically, so that various on-line services arepossible.

As the present invention may be embodied in several forms withoutdeparting from the spirit or essential characteristics thereof, itshould also be understood that the above-described embodiments are notlimited by any of the details of the foregoing description, unlessotherwise specified, but rather should be construed broadly within itsspirit and scope as defined in the appended claims, and therefore allchanges and modifications that fall within the metes and bounds of theclaims, or equivalence of such metes and bounds are therefore intendedto be embraced by the appended claims.

What is claimed is:
 1. A method of storing an image comprising: dividingan image having a prescribed display screen resolution into M horizontalsub cells and N vertical sub cells such that there are a total of M×Nsub cells; compressing each of the sub cells; endowing each compressedsub cell with an index indicating position or coordinate relative to theimage; and integrating the compressed sub cells into a single imagefile; and storing the single image file, wherein based on a userrequest, a prescribed number of sub cells are processed for display on adisplay device, the prescribed number of sub cells being less than M×Nsub cells.
 2. The method of claim 1, wherein the display device of aclient system is coupled to a memory, the memory has a capacity to storedata less than data corresponding to the prescribed display screenresolution.